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(54) Hardware simulation systems and methods for vision inspection systems 



(57) The systems and methods of this invention pro- 
vide simulated images to vision inspection systems. 
The simulated images emulate the vision of a vision 
inspection system. Graphical models of objects in a vir- 



tual world and lens effects models are used to provide 
the simulated images. 
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Description 

[0001] TTiis invention is directed to methods and 
systenr^ that simulate Images prcxiuced by a vision sys- 
tem. More particularly, this invention is directed to meth- s 
ods and systems that generate a synthetic image that 
accurately approximates an image produced by an 
automated vision inspection system. 
[0002] A wide variety of non-contact computer- 
vision-lsased systems exist that recognize or measure io 
key features of parts or materials in a manufacturing 
environment Many of these systerr^ have a 'Gaining" or 
"programming** mode. In the programming mode, the 
system receives instructions regarding hew to recog- 
nize or measure a part. This programming mode results is 
In a set of Instructions that are automatically repeated 
by the system. These instructions may be or^nized as 
a program In a general purpose scripting language or as 
a macro sequence. Stored program Instruction 
sequences In either scripting or nnacro languages are 20 
known as part programs. The sequence of learning or 
training a part program is known as part jDrogramming. 
[0003] Off-line programming software tools are 
popular for traditional, non-image-based coordinate 
measuring machines and robots. Off-line programming 2S 
tools assist a programmer in selecting machine instruc- 
tions to include In a program for the non-image-based 
coordinate measuring machines and robots. However, 
these off-line programming software tools do not 
account for problems exp^ienced when forming optical so 
innages^ through. pl^sk:ai^ lens systems because such 
concerns are rK>t present in traditional, non-image- 
based coordinate measurement machines or robots. 
Therefore, these known off-line programming software 
tools are Inadequate for any machine that includes a 3s 
machine vision system and totally unsurtat^le for nrxxj- 
ern image-based Inspection and/or motion systems. 
[0004] The systems and methods of the invention 
use 3D graphical models of workpieces to simulate the 
images produced by the physical hardware of a vision 40 
inspection system. An exemplary emtxxliment of the 
system and method of this invention provides these syn- 
thetic images at a speed which approximates the real- 
time generation of images In a real vision inspection 
system. The simulation systems arKi methods of this 45 
invention produce synthetic video images that are com- 
parable to the Images that arc captured by a camera 
looking through a lens at a workplece in a vision Inspec- 
tion system. 

[0005] The simulation systems and methods of this so 
invention may be integrated with a user interface from 
machines which include a machine vision system, and 
especial ty with a user Interface from a vision Inspection 
system, to provide an off-line programming environ- 
ment. The term "off-line programming" describes the ss 
creation of a part program without interfering with the 
ongoing operation of a pfiysical vision Inspection sys- 
tem. 



[0006] The methods and systems of the invention 
separately provide vision simulation systems that allow 
vision system designers to develop software-only ver- 
sions of vision inspection systems. Such software-only 
implementations will present the same user interface to 
operators as would be presented by a corresponding ~^ 
physical vision inspection station. Hardware emulation 
modules in the systems and methods of this invention 
simulate physical connponents of the visual inspection 
stations, such as cameras, lighting, lenses and motion 
control platforms. The simulation systems and methods 
of this Invention generate synthetic images based on 
state models of the vision systems arKi computer-aided- 
design models of workpieces to be measured. The com- 
puter-aided-design models of workpieces may be pro- 
vided by conventional commercial CAD packages, such 
as pro/ENGINEER from Parametric Technology Corpo- 
ration, Waltham, MA 02453, and may coincide with the 
CAD data files which govern manufacturing of actual 
workpieces which would eventually be placed under the 
actual vision Inspection station. 
[0007] The syrrthetic images generated by the sys- 
tems and metiiods of this invention may be used in 
place of the video captured by a camera In a hardware- 
based vision system. The systems arxl methods of this 
invention allow designers to readily devebp an off-line 
version of an inspection system by replacing hardware- 
t^ed software sut^systems with subsystems that com- 
municate with virtual components of a vision simulation 
engine. Operators are able to modify parameters in the 
virtual inspection system and immediately see the 
results as a change in tiie synthesized image. Because 
the inspection system simulation systems and methods 
of this Invention are usable with existing vision inspec- 
tion system user interfaces, a user may gain familiarity 
witii the user interface prior to interacting with an actual 
physical vision Inspection system. 
[0008] The inspection system simulation systenrs 
and methods of this invention reduce system downtime 
due to creating new inspection part programs. The sys- 
tems and methods of this invention are also able to 
Improve operator training and to provide inproved tools 
for off-site sales arxl marketing of vision inspection sys- 
tems. 

[0009] These and other features and advantages of 
this invention are described in or are apparent from the 
following detailed description of the exemplary emtxxii- 
ments. 

[0010] The preferred embodiments of this invention 
will be described in detail, with reference to the following 
figures, wherein: 

Rg. 1 is a block diagram of one exenrplary embodi- 
ment of a hardware-based vision inspection sys- 
tem: 

Rg. 2 is a block diagram of the exemplary embodi- 
ment of the vision inspection system using one 
exemplary embodiment of an inspection system 
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simulation system in accordance with this invention; 
Fig. 3 is a block diagram showing in greater detail 
one exemplary embodiment of a vision simulation 
engine in accordance with this invention; and 
Figs. 4A and 4B are a flowchart outlining one exem- 
plary embodiment of a method for rendering syn- 
thesized images in accordance with this invention. 

[0011] Fig. 1 is a block diagram of one exemplary 
embodiment of a physical vision inspection system 10. 
The vision Inspection system 10 includes a vision 
inspection control system 12. The vision inspection con- 
trol system 12 includes a user interface subsystem 14, 
a data processing subsystem 16 and a hardware inter- 
face 20. The hardware interface 20 includes a light con- 
trol subsystem 22. a framegrat>ber subsystem 24. a 
lens controt subsystem 26 and a motion control subsys- 
tem 28. The hardware interface 20 communicates with 
the vision system hardware components 30. In particu- 
lar, the vision system hardware components 30 includes 
lighting hardware 32, framegrabber 34, lens hardware 
36 and motion control hardware 38. The framegrabber 
34 may include an internal or external framegrabber 
mechanism to produce still or real-time digital represen- 
tations of a scene viewed by a monochrome or color 
camera. The camera and the framegrabber 34 combi- 
nation described herein is intended to include both ana- 
log and digital camera configurations. For example, a 
digital camera may include an integral framegrabber. 
[0012] Each of the physical hardware systems 32- 
38 of the vision system hardware components 30 repre- 
sent one or more physical components of a typical 
machine vision inspection system. The systems and 
methods of this invention use graphical and physical 
modeling techniques to replace alt of these components 
with a virtual model of the vision system hardware com- 
ponents 30. 

[0013] One example of a commercially available 
vision inspection system which corresponds to the 
vision inspection system of Fig. 1. is the Quick Vision 
series of vision inspection machines available from 
Mitutoyo America Corporation Aurora, IL One example 
of a commercially available vision inspection control 
system including a user interface subsystem which cor- 
responds to vision inspection control system 12 and 
user interface subsystem 14 of Fig. 1, is the QVPak 
operating software for the Quick Vision series of vision 
inspection machines available from Mitutoyo America 
Corporation Aurora. IL 

[0014] Fig. 2 shows one exemplary embodiment of 
a vision simulation system 100 according to this inven- 
tion, comprising a vision inspection control system 110 
and one exemplary embodiment of a vision system 
hardware components simulation system 140 according 
to this invention. The vision inspection control system 
no is identical to the vision inspection control system 
12 of Fig. 1 and includes a user interface subsystem 
11 4. a data processing subsystem 1 1 6 and a hardware 



interface 120. The hardware interface 120 includes a 
light control subsystem 122, a framegrabber subsystem 
124, a lens control subsystem 126 and a motion control 
subsystem 128. 

5 [0015] The vision system hardware components 
simulation system 140 is preferably implemented on a 
programmed general purpose computer. However, the 
vision system hardware components simulation system 
140 can also be implemented on a special purpose 

10 computer, a programmed microprocessor or microcon- 
troller and peripheral integrated circuit elements, an 
ASIC or other integrated circuit, a digital signal proces- 
sor, a hardwired electronic or logic circuit such as a dis- 
crete element circuit, a programmable logic device such 

75 as a PLD. PLA. FPGA or PAL. or the like. In general, any 
device, capable of implementing a finite state machine 
that is in turn capable of implementing the flowcharts 
shown in Figs. 4A and 4B. can be used to implement the 
vision system hardware components simulation system 

20 140. 

[0016] The hardware interface 120 communicates 
with the vision system hardware components simulation 
system 140 over links 142 and 144. The vision system 
hardware components simulation system 1 40 includes 

25 a vision inspection system simulation processing sub- 
system 146 which communicates with a configuration 
subsystem 148. and an external view 150. 
[0017] It should be appreciated that, if the vision 
system hardware components simulation system 140 is 

30 implemented in hardware or remotely from the vision 
inspection control system 110, the links 142 and 144 
can be any now known or later developed device or sys- 
tem for connecting the vision inspection control system 
1 10 to the vision system hardware components simula- 

35 tion system 140. including a direct cable connection, a 
connection over a wide area network or a local area net- 
work, a connection over an intranet, a connection over 
the Internet, or a connection over any other distributed 
processing network or system. In general, the links 142 

40 and 144 can be any known or later developed connec- 
tion system or structure usable to connect the vision 
inspection control system 1 10 to the vision system hard- 
ware components simulation system 140. 
[0018] If the vision system hardware components 

45 simulation system 140 is implemented locally to the 
vision inspection control system 110. such as by a soft- 
ware application program, the links 142 and 144 are 
software structures that route data and control signals 
between the vision inspection control system 110 and 

50 the vision system hardware components simulation sys- 
tem 140. The vision system hardware components sim- 
ulation system 140 receives control data over the link 
142 from the vision inspection system simulation sys- 
tem 110 and sends synthetic image data over the link 

55 1 44 to the vision inspection control system 110. 

[0019] The configuration subsystem 148 stores 
models of a virtual world and includes a systems light- 
ing model, a motion control model, a workpiece model, 
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and lens and camera configuration data that are used 
by the processing subsystem 146 to produce still and/or 
real-time synthetic images. 

[0020] As shown in Fig. 2, the vision system hard- 
ware components simulation system 140 is integrated 
with the vision inspection control system 110. which is 
intended to drive the physical vision system hardware 
components 30. The vision system hardware compo- 
nents simulation system 140 is a hardware- or software- 
based emulation system that replaces the physical 
cameras, lenses, lights, stages, etc. of the physical 
vision system hardware components 30 shown in Fig. 1 . 
[0021] The vision system hardware conrponents 
simulation system 140 is capable of producing images 
of a simulated vision inspection target at differing 
heights relative to a virtual optical system and camera. 
These synthetic images, which may include out-of-focus 
images and lighting effects, facilitate rapid and intuitive 
off-line programming. 

[0022] The vision system hardware components 
simulation system 140 can also produce a three-dimen- 
sional external view 1 50 of the entire simulated vision 
inspection system. The external view approximates 
vt^t IS seen by the user when physically viewing a 
physical vision inspection system. Such an external 
view provides many important spatial cues to a system 
operator to further facilitate rapid and intuitive off-line 
programming. 

[0023] A user of the systems and metiiods of this 
invention can import and fix computer-aided design 
(CAI>> models of workpieces onto a virtual stage of the 
vision system hardware components simulation system 
140 by importing and storing CAD models in the config- 
uration subsystem 148. Real-time, synthetic digital 
images of the stage and the workpiece are then created 
and provided to the vision inspection control system 1 10 
by the vision system hardware connponents simulation 
system 140. Users may then inspect the simulated 
workpieces on the virtual vision inspection machine 
simulated by the vision system hardware components 
simulation system 140 to select instructions for part pro- 
grams that will run on the physical vision inspection sys- 
tem that is being simulated by the vision system 
hardware components simulation system 140. 
[0024] The processing subsystem 146 creates syn- 
thetic images by taking at least one of the following fac- 
tors into account: camera position and view; light source 
positioning; orientation of the workpiece relative to the 
stage; current position and orientation of the stage rela- 
tive to the camera; lens subsystem parameters, such as 
focal length: the geometry of the modeled lens system; 
the optical effects produced by the lens and lighting sys- 
tems; the optical properties of the workpiece; and the 
physical properties of the workpiece. 
[0025] Rg. 3 shows another exemplary embodi- 
ment of the vision system hardware components simu- 
lation system 140 of the vision simulation system 1 00 in 
accordance witii the invention. As shown in Fig. 3. in 



this exemplary embodiment, the vision system hard- 
ware components simulation system 140 includes an 
input/output interface 200 and a rendering engine 202. 
The interface 200 includes subsystems that store the 

5 poisition of the virtual stage, the parameters for the vir- 
tual lens system and the parameters for the lighting sys- 
tem. The parameters of the virtual lighting system 
include the magnitude, tiie color, the orientation and the 
type of each virtual light source in the syst^. The 

10 parameters of the virtual lens system include magnifica- 
tion, field of view, focal length and d^th of field of the 
simulated lens system. 

[0026] The vision system hardware components 
simulation system 140 also Includes a lighting model 

15 206 which models light emanating from each virtual 
lighting source. The fighting model 206 describes the 
light from each virtual lighting source arKi includes infor- 
mation regarding position, orientation, magnitude, color 
and type of light from each light source. 

20 [0027] The vision system hardware componerrts 
simulation system 140 also includes a virtual world 
model 208, a static environment model 210, a virtual 
stege model 212 and a component model 214. The 
models 208-214 record and update tiie geometrical and 

25 physical modd descriptions of a virtual stage and virtual 
workpieces. Each component is described in the corre- 
sponding model 208-218 in a scene hierarchy consist- 
ent with current graphical surface modeling techniques. 
Each model is a set of polygons connected at a collec- 

30 tion of common nodes. Each node contains information 
such as position, color, material information, and texture 
coordinates. Each object may include one or more tex- 
ture maps to be api:died to the surface faces. 
[0028] The virtual world model 208 stores a com- 

35 plete current 3D model of the virtual stage table, the vir- 
tual movat>te stage components and all of the virtual 
workpieces on the virtual stage. This virtual world 
model 208 is constructed from a hierarchy of compo- 
nents that include the static environment model 21 0. the 

40 virtual stage model 21 2 and the componem model 214, 
including the position and orientation of the workpiece 
on the stage. When the virtual stage moves relative to 
the virtual stage table, the workpieces on the stage 
translate in a global coordinate system accordingly. 

45 [0029] The vision system hardware components 
simulation system 140 also includes a lens system 
model 216 which stores virtual lens system data, such 
as field of view and perspective. The lens system model 
216 transmits lens system data to the rendering engine 

so 202. 

[0030] The foregoing description assumes a typical 
case for many machine vision systems, where the cam- 
era is fixed in a global coordinate system, and the work- 
pieces are moved relative to the camera by means of a 
55 moving stage component, for example an X-Y table, a 
conveyor belt, or the Oke. In other cases, where the 
camera and optical system are mounted in a gantry 
configuration, or on the end of a robotic arm. the camera 
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and optical system move relative to the global coordi- 
nate system, and the workplece remains fixed relative to 
the global coordinate system. In the later case, the light- 
ing model 206 should include the lighting position and 
orientation relative to the workpiece and the lens sys- 
tem, and the lens system model 216 should include the 
lens system position and orientation relative to the 
workpiece(s), stage, static model and world model. In 
the later case, the stage model 21 2 has no moving fea- 
tures, and may be included in the static model. In any 
case, the crucial data for image simulation is the relative 
position and orientation of the optical system, the work- 
piece(s) and the lighting system, and one skilled in the 
art can allocate relative position data for these elements 
to the appropriate models according to any of the well- 
established methods for relating objects in a set of local 
and global coordinate systems. 

[0031] The vision system hardware components 
simulation system 140 also includes a memory 218 
which stores the two-dimensional image. 
[0032] The vision system hardware components 
simulation system 140 also includes a rendering engine 
202. Examples of such a rendering engine is OpenGL 
or DirectSD. OpenGL is an open standard for 3D graph- 
ical rendering which is described in OpenGL Reference 
Manual. OpenGL Architecture Review Board. Addison- 
Wesley Developers Press. Reading, MA. 1996. 
DirectSD is a component of the DirectX system of tools 
distributed by Microsoft Corporation in conjunction with 
their Windows™ operating system. The rendering 
engine 202 accepts as input the 3D polygonal model 
stored in the virtual world model 208, the lens model 
216 and the lighting model 206. The rendering engine 
202 may be any system which produces a two-dimen- 
sional image and a depth map given a three-dimen- 
sional model, using Gouraud shading, raytracing, etc. 
The rendering engine 202 receives the 3D polygonal 
model and lighting data from the lighting model 206 and 
the virtual world model 208, respectively. 
[0033] The rendering engine 202 creates two- 
dimensional image data as viewed through an ideal pin- 
hole lens system. The 2D image data includes a two- 
dimensional mapping which stores the distance of each 
pixel in the image map from the virtual camera. The ren- 
dering engine 202 also generates the three-dimensional 
external view 150 of the virtual world (shown in Fig. 2). 
As described above, the three-dimensional external 
view 150 emulates a view of the system as would be 
seen by an operator of the vision inspection system. 
[0034] The two-dimensional camera image data 
does not simulate real world camera information. The 
two-dimensional camera image data has an infinite 
depth of focus as if it were created using a perfect pin- 
hole camera. This does not accurately simulate the view 
of real machine vision inspection systems, which often 
have vay small depths of field. Therefore, the vision 
system hardware components simulation system 140 
also includes a lens effects processing engine 204. The 



lens effect processing engine 204 receives the two- 
dimensional camera image data including the depth per 
pixel data from the rendering engine 202. The lens 
effects processing engine 204 modifies the camera 

5 image in accordance with the virtual lens parameters. 
The lens effects processing engine 204 outputs a two- 
dimensional image. This two-dimensional image takes 
into account the virtual optical geometry of the system. 
One example of a lens effects processing engine is 

10 described in A Lens and Aperture Camera Model for 
Synthetic Image Generation . Computer Graphics, vol. 
15, no. 3, pp. 297-305, August 1981. 
[0035] It should be understood that the lens effects 
engine 204 and the rendering engine 202 may form por- 

15 tions of a single processor or may be separate proces- 
sors. Moreover, the rendering engine 202 and the lens 
effects engine 204 can be combined into a single ren- 
dering and lens effects engine. Such a combined ren- 
dering and lens effects engine could be used, for 

20 example, with ray tracing rendering to follow each ray 
through the optical system. 

[0036] It should be understood that each of the 
models shown in Fig. 3 can be implemented as portions 
of a suitably programmed general purpose computer 

25 Alternatively, each of the models shown in Fig. 3 can be 
implemented as physically distinct hardware circuits 
within an ASIC, or using FPGA. a PLD. a PLA or a PAL. 
or using discrete logic elements or discrete circuit ele- 
ments. The particular form each of the models shown in 

30 Fig. 3 will take is a design choice and will be obvious 
and predicable to those skilled in the art. 
[0037] Figs. 4A and 4B are a flowchart outlining one 
exemplary embodiment of a method for rendering a 
vision simulation of a vision inspection system in 

35 accordance with this invention. As shown in Fig. 4 A. the 
control routine starts at step SI 00 and continues to step 
SI 02. In step 8102. components of the virtual world, 
such as a table, camera, lighting, etc. are initialized. 
Then, in step Si 04. the models of the workpieces are 

40 added to the virtual world. Next, in step Si 06, a stage 
position is determined. Control then continues to step 
SI 08. 

[0038] In step SI 08. the positions of the virtual 
stage and of all workpieces on the virtual stage are 

45 updated. Next, in step Si 10. the virtual world model is 
updated based on other system parameters, such as 
lighting, lenses, etc. Then, in step 8112, the virtual 
world is rendered to form a two-dimensional camera 
image and a corresponding map of pixel depth data. 

50 Control then continues to step 81 14. which is shown in 
Fig. 4B. Then, in step Si 14, a determination is made 
whether lens effects are required. If lens effects are 
required, control continues to step Si 16. Alternatively, if 
lens effects are not required, control jumps directly to 

55 step 81 18. In step 81 16. virtual lens effects are applied 
to the simulated image. Next, in step 8118. the virtual 
camera view is provided to a vision inspection control 
system. Control then continues to step 8120. 
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[0039] In step Si 20. a determination is made 
whether a virtual external view is required. If a virtual 
external view Is required, control continues to step 
S122. If a virtual external view is not required, control 
jumps directly to step 8124. In step S122. the virtual 5 
external view of the system Is rendered. Then, in step 
S124, a determination ismade whether the vision simu- 
lation engine should be hatted. If the vision simulation 
engine is to be hatted, control continues to step SI 26. If 
the vision simulation system is not to be halted, control 10 
jumps back to step SI 06. In step S126, the vision simu- 
lation engine is stopped. 

[0040] It should be appreciated that steps S112- 
S116 can be combined into a single step that both 
renders the image and simultaneously adds any lens is 
effects to the image. For example, in a ray tracing sys- 
tem, as each ray is used to render a portion of the 
image, the path of that ray is followed through the optical 
system to account for any lens effects. 
[0041 ] It should be further appreciated that the flow- 20 
chart outlined in Figs. 4A and 4B is one exemplary 
embodiment of a more-general method for rendering a 
simulated image from a machine vision system. The 
machine vision system can be a vision ir^ection sys- 
tem or a vision system attached to some other machine. 2S 
such as a robot. This method for rendering the simu- 
lated image includes generating a simulated image of a 
virtual world based upon a first model that characterizes 
or represents at least one object in the virtual world and 
a second model that characterizes or represents an 30 
optoa^ ^slem; and^pr0viding the simulated image to a 
ntachine vison control system. The machine vision con- 
trol system can be an inspection program generation 
system, such as a system for generating a part program 
for the vision inspection system described above, or a 3S 
motion command generation system, such as a system 
for generating motion commarxjs for a rokx>t having a 
machine vision system. 

[0042] Op^ators are able to modify parameters in 
the machine vision system and immediately see the 40 
results as a change in the synthesized or simulated 
image. Because the machine vision simulation systems 
and methiods of this invention are usak>le with existing 
machine vision system user interfaces, such as vision 
inspection system user internees, a user may gain 4S 
familiarity with the machine vision user interface prior to 
interacting with an actual physical vision inspection sys- 
tem. 

[0043] White this invention has been desaibed with 
the specific embodiments outlined above, many alterna- so 
fives, modifications and variations are apparent to those 
skilled In the art. Accordingly, the preferred embodi- 
ments described above are illustrative and not limiting. 
Various changes may be made without departing from 
the spirit and scope of the invention. 55 



Claims 

1. A vision system hardware component simulation 
system for machine vision, comprising: 

a first model representing at least one object; 
a second-model representing an optical sys- 
tem; arxJ 

a processor that generates an image of a vir- 
tual world containing the at least one object 
based upon the first model and the second 
model. 

2. The vision system hardware component simulation 
system of claim 1. wherein: 

at least one of the first and second models 
includes information which characterizes the 
relative orientation atKl position of the corre- 
sponding at least one object and the optical 
system; 

the image of the virtual world comprising an 
image of the at least one object as seen 
through the represented optical system. 

3. The system of claim 1 or daim 2. further conprising 
at least one additional model representing at least 
one of a stage, a workpiece fixture and a lighting 
system, wherein the processor further generates 
the image of the virtual world based on the at least 
one additional nrKxiel. 

4. The system of any of the preceding claims, further 
comprising a control instruction generation system. 

5. The system of any of the preceding claims, wherein 
the second model characterizes at least one of an 
aperture of a lens system, a focal length of the lens 
system, an image magnification of the lens system, 
an optical system geometry of the lens system, and 
an image capture system. 

6. The system of any of the preceding claims, further 
comprising a user internee for a machine vision 
inspection system to simulate, the user interface 
simulating at least one operation of the machine 
vision inspection system independent of at least 
one component of the machine vision inspection 
system. 

7. A method for simulating images based on the char- 
acteristics of at least one machine vision hardware 
component, comprising; 

generating at least a simulated machine vision 
image of a virtual world containing at least one 
object based upon at least a first model that 
characterizes the at least one object and a sec- 
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ond model that characterizes an optical sys- 
tem; and 



providing the simulated image to a machine 
vision control system program. 



5 



B. The method of claim 7, wherein generating the sim- 
ulated image based on the first and second models 
further comprises processing lighting system 
parameters, the lighting system parameters includ- io 
ing at least one of a position and an orientation rel- 
ative to the at least one object, a magnitude, a color 
and a type of at least one lighting source. 

9. The method of claim 7 or claim 8, further compris- is 

ing: 

determining if an external view of the virtual 
world is to be rendered; and 
if the external view is to be rendered, providing so 
the external view to the machine vision control 
system program. 

10. A method for facilitating the generation of at least 
one machine control instruction for a machine hav- 2S 
ing a machine vision system independently of at 
least one element of the machine vision system, the 
method comprising: 

rendering a synthetic image of at least one 30 
object to simulate the view through the 
machine vision system according to a repre- 
sentation of at least one component of the 
machine vision system; and 

selecting a machine control instruction based 35 
at least in part on the synthetic image. 
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